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ENABLING TECHNOLOGIES FOR THE 
NATIONAL SPACE CHALLENGES 


PERMANENT PRESENCE IN SPACE 




• LOWERS MISSION OPERATIONS COSTS 


• INCREASES PRODUCTIVITY 


• RENDERS HIGHER QUALITY DECISIONS 

• MAINTAINS TECHNOLOGICAL LEADERSHIP 
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INCREASE MISSION PRODUCTIVITY 

• AUTOMATE ROUTINE ONBOARD HOUSEKEEPING FUNCTIONS 

INCREASE MISSION SUCCESS PROBABILITY 

• AUTOMATE REAL-TIME CONTINGENCY REPLANNING 


HL/AIAA 9-88 (LAH) 



252 


NASA 

Ames Research Center Information Sciences Division 

“ “ “ “ “ “ ■ Blll - I,,l— “ > 

DESCRIPTION OF INTELLIGENT AUTONOMOUS SYSTEMS 

CHARACTERISTICS 

KNOWLEDGE-BASED SYSTEMS 

• DYNAMIC WORLD KNOWLEDGE ACQUISITION, UNDERSTANDING, 

AND EXECUTION OF COMMAND FUNCTIONS 

• RELIABLE DECISIONS IN UNCERTAIN ENVIRONMENTS 

• LEARNING ABILITY 

• ALLOWS "GRACEFUL" RETURN TO HUMAN CONTROL 

QAJPAB1UI1ES 


GOAL-DRIVEN BEHAVIOR 

• COMMUNICATE AT HIGH LEVELS WITH HUMANS AND OTHER MACHINES 

"COLLABORATIVE" HUMAN-MACHINE INTERACTIONS 

• RECOGNIZE AND RESOLVE COMMAND ERRORS 

SELF-MAINTENANCE 

• OPERATE AUTONOMOUSLY FOR EXTENDED PERIODS OF TIME 
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SYSTEMS AUTONOMY PROGRAM 

HOW DO WE GET THERE - PROGRAM ELEMENTS 


ONGOING CORE TECHNOLOGY 

• PLANNING AND REASONING 

• OPERATOR INTERFACE 

• SYSTEMS ARCHITECTURE 
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IN SPACE 
CONSTRUCTION 


SPACE STATION 


RESEARCH 

PRODUCTS 


TECHNi 

FOCUS 

OLOGY 


PERIODIC DEMONSTRATIONS 


•LONG TERM EVOLVING 
TESTBED 

• SHORT TERM SPECIFIC 
DOMAIN DEMOS 



SHUTTLE 

MISSION CONTROL 


SHUTTLE 

LAUNCH DIAGNOSTICS 
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SYSTEMS AUTONOMY PROGRAM 
TECHNICAL CHALLENGES 


REAL-TIME KNOWLEDGE-BASED SYSTEMS 


DYNAMIC KNOWLEDGE ACQUISITION AND UNDERSTANDING 


PLANNING AND REASONING 


i-BASED SYSTEMS 


VALIDATION METHODOLOGIES 


HL/AIAA 9-88 LAH) 





IMASA 

Information Sciences Divison 

SYSTEMS AUTONOMY PROGRAM - TECHNOLOGICAL CHALLENGES 

A. WHERE WE ARE TODAY 


REAL-TIME KNOWLEDGE-BASED SYSTEMS 

• NO PARALLEL SYMBOLIC-NUMERIC PROCESSORS 

• SLOW SPECIAL-PURPOSE HARDWARE (1 GBYTE MEM, 5 MIPS) 

• PROTOTYPING S/W SHELLS (ART, KEE, KNOWLEDGECRAFT) 

• DIAGNOSIS AND PLANNING DECISIONS IN 1-10 MINUTES 

DYNAMIC KNOWLEDGE-ACQUISITION & UNDERSTANDING 

• NO AUTOMATED EXPANSION OF K-B 

• SMALL STATIC PRE-PROGRAMMED K-B 

• DEC ”XCON” LARGEST (5000 RULES, 2000 COMPONENTS) 

ROBUST PLANNING AND REASONING 

• HEURISTIC RULES ONLY, NO CAUSAL MODELS 

• PRE-MISSION PLANNING (NO REAL-TIME REPLANNING) 

• DIAGNOSIS OF ONLY ANTICIPATED SINGLE FAULTS 

• "FRAGILE" NARROW DOMAINS (RAPID BREAKDOWN AT K-B LIMITS) 

COOPERATING KNOWLEDGE-BASED SYSTEMS 

• SINGLE STANDALONE DOMAIN SPECIFIC SYSTEMS 

• HUMAN INTERACTION ONLY, NO INTELLIGENT SYSTEMS INTERACTION 

VALIDATION METHODOLOGIES 

• CONVENTIONAL TECHNIQUES FOR ALGORITHMIC SYSTEMS 
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DYNAMIC 
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KNOWLEDGE 

SYSTEMS 
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BEFORE 


NOW 


OF POOR QUALITY 


SYSTEMS AUTONOMY PROGRAM DEMONSTRATION 

SYSTEMS AUTONOMY DEMONSTRATION PROJECT (SADP) 
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SPACE STATION 
AUTOMATION 


OBJECTIVES 

DEMONSTRATE TECHNOLOGY FEASIBILITY OF INTELLIGENT 
AUTONOMOUS SYSTEMS FOR SPACE STATION THROUGH TESTBED 
DEMONSTRATIONS 

♦ 1988: SINGLE SUBSYSTEM (THERMAL) 

• 1990: TWO COOPERATING SUBSYSTEMS (THERMAL/POWER) 

• 1993: HIERARCHICAL CONTROL OF SEVERAL SUBSYSTEMS 

♦ 1996: DISTRIBUTED CONTROL OF MULTIPLE SUBSYSTEMS 



PARTICIPANTS AND FACILITIES 


SCHEDULE 


PARTICIPANTS 


87 88 89 90 91 92 93 94 95 96 


AMES RESEARCH CENTER 
JOHNSON SPACE CENTER 
LEWIS RESEARCH CENTER 
MARSHALL SPACE FLIGHT CENTER 
INDUSTRY 


FACILITIES 


TCS/Power 

Hierarchical 
Multiple Sys. 

Distributed 
Multiple Sys, 


• ARC INTELLIGENT SYSTEMS LABORATORY 

• JSC INTELLIGENT SYSTEMS LABORATORY 

• JSC THERMAL TEST BED 

• LeRC POWER TEST BED 
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1988 DEMONSTRATION 

SYSTEMS AUTONOMY DEMONSTRATION PROJECT 

SPACE STATION THERMAL CONTROL SYSTEM (TEXSYS) 


IMPLEMENTATION OF Al TECHNOLOGY INTO THE REAL-TIME 
DYNAMIC ENVIRONMENT OF A COMPLEX ELECTRICAL-MECHANICAL 
SPACE STATION SYSTEM - THE THERMAL CONTROL SYSTEM. 

• REAL-TIME CONTROL 

• FAULT DIAGNOSIS AND CORRECTION 

• TREND ANALYSIS FOR INCIPIENT FAILURE PREVENTION 

• INTELLIGENT HUMAN INTERFACE 

• CAUSAL MODELLING 

• VALIDATION TECHNIQUES 


PARTICIPANTS AND FACILITIES 


SCHEDULE 


PARTICIPANTS 


87 88 I 89 I 90 I 91 I 92 


AMES RESEARCH CENTER 

JOHNSON SPACE CENTER 

INDUSTRY: LEMSCO, ROCKWELL INTERNATIONAL, 
GEOCONTROL SYSTEMS, STERLING SOFTWARE 


Development 
Requirements Definition 
Design Definition 
Integration V & V 


TCS Demonstration 


ARC INTELLIGENT SYSTEMS LABORATORY 
JSC INTELLIGENT SYSTEMS LABORATORY 


Power System Interfaces 
TCS/Power Demonstration 


JSC THERMAL TEST BED 


Analysis, Reporting 
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SYSTEM AUTONOMY DEMONSTRATION PROJECT 

TCS FUNCTIONAL CAPABILITIES 

PROTOTYPE OBJECTIVES 

DEMO 
1 / 8 7 



i 

CAUSAL MODELS/SIMULATION 

• 

▼ 

KNOWLEDGE BASE EXPANSION 

LIMITED FAULT DIAGNOSIS 

• 

DEMONSTRATION OBJECTIVES 

1 

6/87 

2 

9/87 

3 

12/87 

4 

2/88 

5 

5/88 

NOMINAL REAL-TIME CONTROL 




• 

• 

FAULT DIAGNOSIS AND CORRECTION 




• 

• 

TREND ANALYSIS 

O 




• 

INTELLIGENT INTERFACE 

O 

o 



• 

DESIGN ASSISTANCE 

o 

o 

o 


• 

TRAINING ASSISTANCE 

o 

o 

o 


• 
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SYSTEMS AUTONOMY PROGRAM - TECHNOLOGICAL CHALLENGES 

B. WHERE WE NEED TO GO 


REAL-TIME KNOWLEDGE-BASED SYSTEMS 

• PARALLEL SYMBOLIC-NUMERIC PROCESSORS (100 GBYTES, 500 MIPS) 

• NEURAL NETWORKS (BRAIN CELL EMULATION) 

• LAYERED TRANSPARENT SW 

• DIAGNOSIS AND PLANNING IN MILLISECONDS 

DYNAMIC KNOWLEDGE ACQUISITION & UNDERSTANDING 

• AUTOMATED K-B EXPANSION IN REAL-TIME (LEARNING) 

• LARGE DYNAMIC DISTRIBUTED K-B 

ROBUST PLANNING AND REASONING 

• COMBINED HEURISTIC RULES AND CAUSAL MODELS 

• REAL-TIME CONTINGENCY REPLANNING 

• DIAGNOSIS OF UNANTICIPATED FAULTS 

• SPECIFIC DOMAINS ON BROAD GENERIC K-B (GRACEFUL DEGRADATION) 

COOPERATING KNOWLEDGE-BASED SYSTEMS 

• HIERARCHICAL AND DISTRIBUTED SYSTEMS 

• HUMAN AND INTELLIGENT SYSTEMS INTERACTION 

VALIDATION METHODOLOGIES 

• METHODOLOGY FOR EVALUATING DECISION QUALITY 

• FORMAL THEORETICAL FOUNDATION 


V. 
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Architecture of an Autonomous Intelligent System) 
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Expectations 


Actualities 


Nominal World 
State Changes 


I 


Monitor 


Direct World 
State Updates, 


KNOWLEDGE BASE 

Dynamic World Model 
CAD/CAM Data Base 
System Configuration 
Heuristic Rules 


Inferred World 
State Updates 


Vernier 

Control 


Anomalies 


Replan Order 


Nominal Plan 


Executor 


System Architecture A Integration 
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Technology Demonstration - Evolutionary Sequence 


1988 

Automated Control Of Single Subsystem 
("Intelligent Aide") 

Thermal Control System 

* Monitor/real-time control of a single subsystem 

* Goal and causal explanation displays 

* Rule-based simulation 

* Fault recognition/warning/limited diagnosis 

* Resource management 

* Reasoning assuming standard procedures 


1990 

Automated Control of Multiple 
Subsystems ("Intelligent Apprentice") 

Thermal Control System and Power 
System 

* Coordinated control of multiple subsystems 

* Operator aids for unanticipated failures 

* Model-based simulation 

* Fault diagnosis for anticipated failures 

* Real-time planning/replanning 

* Reasoning about nonstandard procedures 

1993 

1996 

Hierarchical Control of 

Distributed Control Of 

Multiple Subsystems 

Multiple Subsystems 

("Intelligent Assistant") 

("Intelligent Associate") 

* Multiple subsystem control: ground and space 

* Autonomous cooperative controllers 

* Task-oriented dialogue & human error 

* Goal-driven natural language interface 

tolerance 

* Fault prediction and trend analysis 

* Fault recovery from unanticipated failures 

* Automated real-time planning/replanning 

* Planning under uncertainty 

* Reasoning/learning, supervision of on-board 

* Reasoning about emergency procedures 

systems 
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AUTONOMOUS SYSTEMS FOR ADVANCED LAUNCH SYSTEMS (ALS) 

UNMANNED LAUNCH VEHICLES 



NASA AMES RESEARCH CENTER 
OAST/AF-SPONSORED RESEARCH 
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Al Research Issues 


MACHINE LEARNING 

COOPERATING KNOWLEDGE-BASED SYSTEMS 

REAL-TIME ADVANCED PLANNING AND SCHEDULING 
METHODOLOGIES 

MANAGEMENT OF UNCERTAINTY 

AUTOMATED DESIGN KNOWLEDGE CAPTURE 

VALIDATION OF KNOWLEDE-BASED SYSTEMS 
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COOPERATIVE INTELLIGENT SYSTEMS 




DESIGN KNOWLEDGE LOST WHEN DESIGNER LEAVES: 


tsj 



WHY DID THEY CHOOSE 
SILVER INSTEAD OF STEEL? 


CONSERVATION OF DESIGN KNOWLEDGE 


ELECTRONIC NOTEBOOK 




0 CtyON 
KNOWLEDGE 
i FROM 
MFECVCLE 

OQMAJN 
KNOWLEDGE 




HUMAN USE; 


PROCESS CONTROL 
DIAGNOSIS 
REPAIR 
DESIGN 


AUTOMATED USE: 



"(DRIVEN-BY 

SOBJECT 

MOTOR-3977)' 
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AUTOCLAS5 









AUTOCLASS 



The spectra show two closely related IRAS classes with peaks at 9.7 and 10.0 microns. 
This discrimination was achieved by considering all channels of each spectrum. AutoClass 
currently has no model of spectral continuity. The same results would be found if the 
channels were randomly reordered. 

The galactic location data, not used in the classification, tends to confirm that the clas- 
sification represents real differences in the sources. 
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Function 


Technology 

Status 


Technology 

Forecast 


Examples 


Evolution of Advanced Architectures 

for 

Real-time, On-board Teraflop Systems 


RT Image Processing 


Applied R&D 


Late 1990s 


KBS-controlled 
Photonic Processor 


Knowledge Under- 
standing & Control 


Development 


Current 


SVMS 

(6-Processor System) 



Deep Reasoning 


Basic Research 


Early 2000s 


Neural Networks 
Fuzzy Logic Computes 
and Controllers 
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Computer Architecture Research Issues 
(Numeric/Symbolic Multiprocessor Systems) 


• OPERATING SYSTEMS FOR REAL-TIME MULTIPROCESSING SYSTEMS 
IN A HETEROGENEOUS ENVIRONMENT 

• VALIDATED COMPILERS AND TRANSLATORS FOR AN ADA-BASED 
MULTIPROCESSING ENVIRONMENT 

• DATABASE MANAGEMENT FOR LARGE DISTRIBUTED DATABASES 
GREATER THAN 10GB 

• AUTOMATED LOAD SCHEDULING FOR MULTIPROCESSORS 

• REAL-TIME FAULT TOLERANCE AND RECONFIGURATION 

• RADIATION HARDNESS WITH MINIMUM PERFORMANCE COMPROMISES 

• PROCESS TECHNOLOGY 

• VLSI/VHSIC TRADEOFFS 

• EFFICIENT COMPILERS AND INSTRUCTION SET ARCHITECTURES 




/ 
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SPACEBORNE VHSIC IVIUL I IPROCESSUR SYSIEM (SVIVIS) 
NASA/AF/DARPA COLLABORATION 


S' 


PROCESS 


VHSIC TECHNOLOGY 


0.5p TARGET 
1 ,25 /j BACKUP 


RAD-HARD CMOS 


10 5 RADS RADIATION RESISTANCE 
NO SINGLE EVENT UPSETS 



r-o 

CD 


S = s 

SYSTEM CHARACTERISTICS 

•PARALLEL ARCHITECTURE 

40 BIT SYMBOLIC PROCESSORS 
32-BIT NUMERIC PROCESSORS 

• FAULT-TOLERANCE/AUTOMATED 
RECONFIGURATION 

•OPTICAL INTERCONNECTS i 

*25 MIPS SUSTAINED UNIPROCESSOR 
PERFORMANCE (40 MIPS TARGET) 

-MINIMUM OF 100 MIPS OVERALL 
SYSTEM PERFORMANCE 

•DBMS FOR 1 0G BYTE MEMORY j 

MANAGEMENT 




STACKCACHE 

MEMORY 


BUS CONTROLLER 


32 bit DATA + 8 bit TAG 
PROCESSING UNIT 


SCRATCH 

PAD 

MEMORY 


MICRO 

SEQUENCER 


MICROCODE 


OPERAND 

ADDRESS 

GENERATION 


INSTRUC- 

INSTRUCTION PIPELINE 

1 

TION 

CACHE 

MEMORY INTERFACE 

MMU 



POTENTIAL SPACE 
& 

AERONAUTICS APPLICATIONS 






PHOTONIC PROCESSOR FOR REAL-TIME IMAGE UNDERSTANDING 


CO 

"O 
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OBJECTIVES 


REAL-TIME PHOTONIC PROCESSORS 
& TECHNIQUES 
for Terrain Analysis Tasks 


SYSTEM CONTROL & INTEGRATION OF 
EMBEDDED PHOTONIC PROCESSORS 
with Integrated Numeric/Symbolic 
Multiprocessor Systems 


• TECHNOLOGY FEASIBILITY DEMONSTRATIONS 
Focused on Planetary Rovers & Space Vehicles 


BENEFITS 


• Real-time, High Performance Parallel Processing 

for Image Processing ^ Understanding 

• Fault Tolerance 

• Low Power. Weight, and Size 



POTENTIAL APPLICATIONS 



Autonomous Landing 

0 



Sample Acquisition and Analysis 



Sample Return 
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IMAGE UNDERSTANDING SYSTEMS 
I Low Le»*t Vu.on Mid-level Vnton Hiah-Level Vmon 







Input ^ 

Image — ^ 

Optic*) I 

Electronic 


Correlator 

Controller 




Symbolic 

Processor 


• Image 

Enhancement 

• Non* 
Suppression 


• Hypothesis 
Verification 

* Pattern 

. Recognition 


• Rule -Bate System | 

• Hypothesis 
Generation 

• World Model 
Generation 

• Data Base 
Searching 




Knowledge-Based Systems 

The tasks involved with an image-understanding- system 
can be divided into three layers as shown. The problem is 
to find a synergistic balance between all layers so that as 
knowledge of the image accrues, the reliability of the 
interpretation , recognition, and enhancement increases, 
while the amount of required computation decreases. 
Methodologies of organizing a knowledge-base of object 
and using a rule-based system to effectively search the 
knowledge-base and directing the computations of pho- 
tonic processors are being developed. The majority of the 
domain specific knowledge for a task will reside in the 
interpretative level making the photonic processor a 
general purpose computing tool. 
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COLLABORATIVE Al AND COMPUTER ARCHITECTURES RESEARCH TEAM 
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CD 
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Machine Learning 


Cooperating Knowledge- 
Based Systems, Data 
Accelerators.AI/ 
Robotics Integration, 
and R/T Control ot 
Flexfoie Manipulator 

TeleaLitonomy and 
Machine Learning 


Fuzzy Logic 
Processors 


Man-Machine Inter- 
face, Intelligent On- 
board Space Sciences 
Systems 


Architectures 
S/W for Work 
Stations 


Space Station 

Automation 

Technologies 


Autonomous 

Systems 

Technologies 


Procedural 

Reasoning 



Beta Test- 
Site for Symbolic/ 
Numeric Processors 
and Collaborative 
Research 


Expert Systems 

Development 

Tools 


Intelligent Systems 
Research and 
Advanced Computer 
Architectures 


KB Systems 
For Space 
Science 


Ground Data 
Systems Auto- 
mation and Right 
Processors 


Al Tech for Shuttle 
and Space Station 
Automation 


Design Data 
Capture with 
ST Focus 


POCCandK-B 
Systems Distributed 
Data Bases 


Launch Operations 


Space Station Automation 
(Power) 


Collaboration between 
Telerobotics and 
Systems Autonomy 


GOVERNMENT 
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